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CLAIMS 

1 . A method for automatically recognizing one or more structures in digitized image 
data, comprising the following steps: 

providing at least one reference graph comprising digitized reference image data of 
corresponding reference images, the reference graph or each reference graph compris- 
ing: 

a net-like structure, the respective net-like structure being defined in that specific 
reference image data have assigned thereto nodes which are interconnected by 
links in a predetermined manner, and 

jets, each node having a jet assigned thereto and each jet comprising at least 
one sub-jet which is determined by convolutions of at least one class of filter 
functions with different magnitudes and/or orientations with the reference image 
data of the corresponding reference image at the specific node, or by convolu- 
tions of at least one class of filter functions with different magnitudes and/or 
orientations with colour-segmented reference image data of the corresponding 
reference image at the specific node, or by colour information on the reference 
image data at said specific node, or by texture descriptions of the correspond- 
ing reference image at the specific node, said texture descriptions being gained 
by statistical methods, or by motion vectors at the specific node, said motion 
vectors being extracted from successive reference images, 

determining an optimum image graph from the digitized image data for each reference 
graph, said optimum image graph representing for a specific reference graph the op- 
timum adaptation to said reference graph and being determined by: 

projecting the net-like structure of said specific reference graph into the image 
data whereby the structure of the image graph is defined, and 
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determining sub-jets of the image graph at the nodes defined by its structure, said 
sub-jets corresponding to at least part of the determined sub-jets of the specific 
reference graph, and 

the projection of the net-like structure of said specific reference graph being varied 
until a graph comparison function which compares the jets of the image graph 
with the corresponding jets of said specific reference graph becomes optimal, 

associating the structure or each structure with the reference image corresponding to the 
reference graph for which the graph comparison function is optimal with respect to the 
optimal image graph determined for said reference graph. 

2. The method according to claim 1 , wherein in addition 

a plurality of reference graphs is provided, and 

the reference graphs, which have net-like structures that are topologically identical, are 
combined to form a reference bunch graph, said reference bunch graph comprising: 

a net-like structure defined by nodes which correspond to the nodes of the refer- 
ence graphs and by links which are determined by averaging the corresponding 
links of the reference graphs, and 

bunch jets, each of said bunch jets being composed of the sub-jets conresponding 
to the sub-jets at the respective nodes of the reference graphs combined in the 
reference bunch graph; 

and 

an optimum image graph is determined for the or for each reference bunch graph, 
said optimum image graph representing for a specific reference bunch graph the op- 
timum adaptation to said reference bunch graph and being determined by: 
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projecting the net-like structure of said specific reference bunch graph into the 
image data whereby the structure of the image graph is defined, and 

determining sub-jets corresponding to at least part of the sub-jets which have 
been used for determining the sub-jets of the reference graphs underlying the 
specific reference bunch graph, and 

the projection of the net-like structure of said specific reference bunch graph being 
varied until a graph comparison function which compares the jets of the image 
graph with the corresponding bunch jets of said specific reference bunch graph 
becomes optimal, 

each sub-jet of the image graph being compared with the sub-jets in the conre- 
spending bunch jet of said specific reference bunch graph; 

' and wherein finally 

iX each structure is associated with the reference image corresponding to the reference 
: graph or to the reference graph from the reference bunch graph or graphs for which the 
iZ graph comparison function is optimal with respect to the optimal image graph determined 
for said reference graph. 

3. The method according to claim 2, wherein only part of the reference graphs provided 
are combined so as to form one or a plurality of reference bunch graphs. 

4. The method according to claim 2, wherein all the reference graphs provided are com- 
bined so as to form one or a plurality of reference bunch graphs. 

5. The method according to one of the preceding claims, wherein the structure of the 
node-associated jets, which is determined by the sub-jets, depends on the respective 
node. 
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6. The method according to one of the claims 1 to 4, wherein the structure of the node- 
associated jets, which is determined by the sub-jets, is identical for all nodes. 

7. The method according to one of the preceding claims, wherein a graph comparison 
function is used, which comprises a jet comparison function that takes into account the 
similarity of the jets corresponding to one another. 

8. The method according to claim 7, wherein the graph comparison function additionally 
comprises a comparison function for the net-like structure, which takes into account the 
metric similarity of the image graph and the corresponding reference graph or the corre- 
sponding reference bunch graph, 

9. The method according to claim 8, wherein the graph comparison function is defined 
as a weighted sum of the jet comparison function and of the comparison function for the 
net-like structure. 

10. The method according to one of the claims 7 to 9, wherein the jet comparison func- 
tion is defined as a function of single jet comparison functions of jets corresponding to 
one another. 

1 1 . The method according to claim 10, wherein the jet comparison function is defined as 
a weighted sum of the single jet comparison functions and/or as a weighted product of 
the single jet comparison functions. 

1 2. The method according to claim 1 0 or 1 1 , wherein sub-jets of the corresponding jets 
are taken into account for determining a single jet comparison, and wherein a single jet 
comparison function is defined as a function of sub-jet comparison functions. 

13. The method according to claim 12, wherein the single jet comparison functions are 
defined as weighted sum of the sub-jet comparison functions and/or as a weighted prod- 
uct of the sub-jet comparison functions and/or as extremum of the sub-jet comparison 
functions. 
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14. The method according to one of the claims 7 to 13, wherein different node- 
dependent jet comparison functions and/or single jet comparison functions and/or sub-jet 
comparison functions are used. 

15. The method according to one of the claims 7 to 9 in combination with claim 2, wherein 
the bunch jets of the reference bunch graph B" are divided into sub-bunch jets , and 

the jet comparison function between the sub-bunch jets of the reference bunch graph 
and the con-esponding sub-jets j,' of the image graph G' for n nodes for m recursions is 
calculated according to the following formulae: 

Sj«.(B",G') = 2G)„S„(B^j;),or 

n 

S,,,(B", G- ) = n (S„(Br. J„' , wherein 

n 

(D„ is a weighting factor for the n-th node n, and the comparison function S^CB^f, J„') 
for the n-th node of the reference bunch graph with the n-th node of the image graph 
is given by: 

S(B'^, J' ) = q({sM, j,' )}) =: ^(M) , with 
Q(°)(M) = 5]©inP(MP), or 

i 

Q«')(M)=nK^(MP)r'°'' 

Q<°>(M) = max{o iQP(MP)} , or 

n<°>(M) = min{cDinP>(MP^)} , wherein |J M^^ = M 



^,^(m-D ) = ^ to pf^ {Mf^ ) , or 
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j^(m-i)(^(D) ^ [^(^^(Mf , or 

i 

^(m-i)(,^(m-i) J = maxjcD j"')(M|'">)} , or 

^(m-i)(,^(rrHi)j ^ fTi infcD jOf HMj"' )} , whereip \jMf"^ = M^'^ and with 
' i 

S(b^r) = X«nS„(Cj').or 

n 

S(b",n = n(Sn(jn.j')r.or 

n 

S(b^r) = max{G)A(jnJ')}.or 
S(b^n = min{a)A(jn.r)}- 

16. The method according to claim 15, wherein the sub-bunch jets of the reference 
bunch graph or graphs comprise only features which have been determined by convolu- 
tions of at least one class of filter functions with different magnitudes and/or orientations 
with the reference image data of the corresponding reference image at the specific node, 
or by convolutions of at least one class of filter functions with different magnitudes and/or 
orientations with colour-segmented reference image data of the corresponding reference 
image at said specific node, or by colour information on the reference image data at said 
specific node, or by texture descriptions of the corresponding reference image at said 
specific node, said texture descriptions being gained with statistical methods, or by mo- 
tion vectors at said specific node, said motion vectors being extracted from successive 
reference images. 

17. The method according to claim 15, wherein the sub-bunch jets of the reference 
bunch graph or graphs comprise only features which result from a reference graph. 

18. The method according to one of the preceding claims, wherein, after the recognition 
of each structure, a step for determining the significance of the recognition is provided. 
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19. The method according to claim 18, wherein an estimator is used for determining the 
significance, said estimator taking into account the optimum graph comparison function 
as well as the non-optimum graph comparison function. 

20. The method according to claim 19, wherein the distance of the values of the non- 
optimum graph comparison functions from the value of the optimum graph comparison 
function is used as an estimator. 

21 . The method according to one of the preceding claims, wherein, in addition, each 
structure is associated with the reference images corresponding to the reference graphs 
and/or the reference graphs from the reference bunch graphs for which the values of the 
graph comparison functions lie within a predetermined range. 

22. The method according to one of the preceding claims, wherein the colour informa- 
tion comprises hue values and/or colour saturation values and/or intensity values de- 
termined from the reference image data and the image data, respectively. 

23. The method according to one of the claims 1 to 22, wherein the step of providing the 
reference graphs and the reference bunch graphs, respectively, comprises fetching the 
reference graphs and the reference bunch graphs from a central and/or decentralized 
data base. 

24. The method according to one of the preceding claims, wherein a regular grid is used 
as a net-like structure of the reference graph, the nodes and links of said regular grid 
defining rectangular meshes. 

25. The method according to one of the claims 1 to 23, wherein an irregular grid is used 
as a net-like structure of the reference graph, the nodes and links of said irregular grid 
being adapted to the structure to be recognized. 

26. The method according to claim 25, wherein the nodes are associated with charac- 
teristic points, so-called landmarks, of the structure to be recognized. 
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27. The method according to one of the preceding claims, wherein Gabor filter functions 
and/or Mallat filter functions are used as class of filter functions for convolution with the 
reference image data and image data, respectively. 

28. The method according to one of the preceding claims, wherein Gabor filter functions 
and/or Mallat filter functions are used as class of filter functions for convolution with the 
colour-segmented reference image data and image data, respectively. 

29. The method according to one of the preceding claims, wherein the projection of the 
net-like structure of the specific reference graph and/or the specific reference bunch 
graph comprises centering the reference graph and/or the specific reference bunch 

Si graph in the image, 

30. The method according to claim 29, wherein the projection of the net-like structure of 
m the specific reference graph and/or of the specific reference bunch graph comprises a 

%i displacement and/or rotation of the centered reference graph and of the centered refer- 
; Q ence bunch graph, respectively. 

I ^ 31 . The method according to claim 29 or 30, wherein the projection of the net-like 
structure of the specific reference graph and/or of the specific reference bunch graph 
comprises scaling the centered reference graph and the centered reference bunch graph, 
respectively, 

32. The method according to claim 31 in combination with claim 30, wherein the dis- 
placement and the scaling and the rotation of the centered reference graph and of the 
centered reference bunch graph, respectively, are carried out simultaneously, 

33. The method according to one of the claims 29 to 32, wherein the projection of the 
net-like structure comprises local distortions of the centered reference graph. 
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34. The method according to claim 33, wherein a local distortion is caused by locally 
displacing a respective node of the centered reference graph. 

35. The method according to one of the claims 30 to 34, wherein the displacement 
and/or the scaling and/or the rotation are determined on the basis of a comparison be- 
tween the image graph and the corresponding reference graph and/or the corresponding 
reference bunch graph. 
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Abstract 

The invention relates to a method for automatically recognizing one or a plurality of 
structures in digitized image data. The method according to the present invention com- 
prises the steps of (a) providing at least one reference graph comprising digitized refer- 
ence image data of corresponding reference images, the reference graph or each refer- 
ence graph comprising a net-like structure, the respective net-like structure being de- 
fined in that specific reference image data have assigned thereto nodes which are inter- 
connected by links in a predetennined manner, and jets, each node having a jet as- 
signed thereto and each jet comprising at least one sub-jet which is determined by con- 
volutions of at least one class of filter functions with different magnitudes and/or orienta- 
tions with the reference image data of the corresponding reference image at the specific 
node, or by convolutions of at least one class of filter functions with different magnitudes 
and/or orientations with colour-segmented reference image data of the corresponding 
reference image at the specific node, or by colour information on the reference image 
data at the specific node, or by texture descriptions of the corresponding reference im- 
age at the specific node, said texture descriptions being gained by statistical methods, or 
by motion vectors at the specific node, said motion vectors being extracted from suc- 
cessive reference images, (b) determining an optimum image graph from the digitized 
image data for each reference graph, said optimum image graph representing for a spe- 
cific reference graph the optimum adaptation to said reference graph and being deter- 
mined by: projecting the net-like structure of said specific reference graph into the image 
data whereby the structure of the image graph is defined, and determining sub-jets of the 
image graph at the nodes defined by its structure, said sub-jets corresponding to at least 
part of the determined sub-jets of the specific reference graph, and the projection of the 
net-like structure of said specific reference graph being varied until a graph comparison 
function which compares the jets of the image graph with the corresponding jets of said 
specific reference graph becomes optimal, and (c) associating the structure or each 
structure with the reference image corresponding to the reference graph for which the 
graph comparison function is optimal with respect to the optimal image graph determined 
for said reference graph. 



